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LECTURE 26. EIGENVALUES AND EIGENVECTORS 



We study the system 

(26.1) y' = Ay, 

where A = {aij) is a constant n x n matrix. 

When n = 1, the above system reduces to the scalar equation y' = ay, and it has solutions of the 
form ce"*. For n ^ 2, similarly, we try solutions of the form ue^*, where v G M*^ and A G C. Then, 

(26.1) becomes 

Xve^^ = Ave^K 

Subsequently, 

(26.2) Av = \v, {A-\l)v = ^. 

In order to find a solution (26.1) in the form of ve^^ we want to find a nonzero vector v and 
A G C satisfying (26.2). It leads to the following useful notions in linear algebra. 

Definition 26.1. A nonzero vector v satisfying (26.2) is called an eigenvector of A with the eigenvalue 
A(G C). 

These words are hybrids of English and German, and they follow German usage, "ei" rhymes 

with TT. 

We recognize that (26.2) is a linear system of equations for v. A well-known result from linear 
algebra is that it has a nontrivial solution v if and only \i A — \1 is singular. That is, pa (A) = 
\A — AI| = 0, where pa(A) is the characteristic polynomial of A. In this case, such a nontrivial 
solution i; is an eigenvector and the corresponding root of "PA^}^ = is an eigenvalue. 

Plane systems. For a 2 x 2 matrix A= [^^^ ^^"^ ) the characteristic polynomial is 

V«21 022/ ^ 



p(A) 



an - A ai2 

021 ^22 ~ A 



A^ - (tr^)A + det A 



This quadratic polynomial has two roots, Ai and A2 (not necessarily distinct). Let vi and V2 be the 
eigenvectors corresponding to the eigenvalues Ai and A2, respectively. By definition, vie^^^ and 
^26^^* are solutions of (26.1). 

If Ai 7^ A2, then the functions vie^^^ and ^26^2* are linearly independent. Hence, they form a 
basis of solutions of (26.1).The general solution of (26.1) is given as 

y{t) = ciiTie^i* + C2V2e^^\ 

where ci, C2 are arbitrary constants. This shows one use of eigenvalues in the study of (26.1). 
Let us define 2x2 matrices 

V = {vi V2) and A = diag (Ai, A2) = (^^^ . 

One can verify that AV = VA. If vi and V2 are linearly independent, so that \ V\ 7^ 0, then we can 
make the (non-singular) change of variables 

X = V~^y. 



1 



Then, (26.1) is transformed into x' = Ax, that is 

x'l = Aixi, 
x'2 = A2X2. 

That is, X solves a decoupled system. The solution of this system is immediate and xi = cie^^^, 
X2 = C2e^^^. The new variables x is called the canonical variables, and A = V~^AV is called the 
diagonalization. This is another use of eigenvalues. Canonical variables play a major role i engi- 
neering, economics, mechanics, and indeed in all fields that makes intensive use of linear systems 
with constant coefficients. 

Lemma 26.2. If the eigenvalues of a 2 x 2 matrix are distinct, then the corresponding eigenvectors are 
linearly independent. 

Proof. Suppose that the eigenvalues Ai / A2, but the eignevectors satisfy 

(26.3) civi + C2V2 = 0. 

We want to show that ci = C2 = 0. Applying the matrix A to (26.3), we obtain that 

(26.4) ciAiiTi + C2X2V2 = 0. 
Subtraction then yields 

ci(A2 - Ai)ui = 0. 
This implies ci = 0. Then, (26.3) implies 02 = 0. 



□ 



Example 26.3. We consider A 



12 5' 
-6 II- 



Its characteristic polynomial is p{X) = A^ — 13A + 42 = (A — 6)(A — 7), and A has two distinct 
eigenvalues, Ai = 6 and A2 = 7. 

If Ai = 6, then A — 61 = (^^q ' ^qJ eigenvector. 

If A2 = 7, then A — 7I= (^^q ^qJ > ^ eigenvector. The general solution of (26.1) 

vit) = cie^' (.^e) + ''''' (-1) ■ 



is, thus. 



5 I \ ^ (yi\ _ ( -yi- y2 



The canonical variable is x — . „ , 1 — 1^ ,r 

\^-6 -IJ \y2j \6yi+^y2 

Exercises. 1. Show that A= (^^^ has only one eigenvalue A = 7, and the only corresponding 
eigenvector is . In this case, we can't construct the general solution of (26.1) from this. 

2. Show that A= ^ has two (complex) eigenvalues l±2i and the corresponding eigen- 
vectors ( iL • ) , respectively. They leads to the general (complex) solution of (26.1) 



{l+2i)t f 1 \ , r^„M-'2i)t I 1 



2i ' ^ \-2i r 
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Higher-dimensional systems. If A is an n x n matrix, where n ^ 1 is an integer, then 

Pa{X) = \A-XI\ 

is a polynomial in A of degree n and has n roots, not necessarily distinct. That means, A has n 
eigenvalues Ai, . . . , A„, not necessarily distinct. Let vi, . . . ,Vnhe the eigenvectors corresponding 
to Ai, . . . , An, respectively. Let 

V = {vi ■■■ Vn) and A = diag (Ai, . . . , A^). 

By definition, wie^i*, . . . , Vn^^"* are solutions of (26.1). 

If |y| / 0, that means, if i/i, . . . , u„ are linearly independent, then they form a basis of solutions 
of (26.1). Moreover, x = V~^y is a canonical variable and x' = Kx. In many cases, the vectors Vj 
can be chosen linearly independent even if \j are not all distinct. Sometimes the condition | y | 7^ 
is met by the following. 

Lemma 26.4. If eigenvalues Ai, . . . , An are distinct, then the corresponding eigenvectors vi, . . . ,Vn are 
linearly independent. 

Proof. Suppose not. Let m > 1 be the minimal number of vectors that are linearly dependent. 
Without loss of generality, we assume that vi,...,Vrn are linearly dependent, so that 

(26.5) CiVi + C2V2 H h CmVm = 

and some cj is nonzero. We further assume that C2 7^ 0. 

We now proceed similarly to Lemma 26.2. Applying A to (26.5) we obtain 

ClXlVl + C2X2V2 H h CmXmVm = 0. 

Multiplying by Ai then 

CiAiVi + C2X1V2 H h CmXiVm = 0. 

Thus, we have 

C2(A2 - Ai)-U2 H h CmiXm - Xi)Vm = 0. 

Since V2, - ■ ■ ,Vrn are linearly independent, C2 = • • • = Cm = must hold. A contradiction then 
proves the assertion. □ 

We recall that if A = A^ then the square matrix A is called symmetric. If a complex matrix 
satisfies A = A*, where A* denotes the conjugate transpose or adjoint of A, then A is called 
Hermitian. A symmetric or a Hermitian matrix has many important properties pertaining to the 
study of (26.1) via eigenvalues. 

(1) All eigenvalues of a symmetric matrix are real and eigenvalues of A corresponding to differ- 
ent eignevalues are orthogonal. 

Proof. Let 

AH = Xu, Av = uv, 

u,v and X ^ ijl. Then, 

%F Au = Xif"u, if^A^u = Xv^u. 
Since A = , it implies that A = A. The second assertion is left as an exercise. □ 

(2) A has n linearly independent eigenvectors (regardless of the multiplicity of eigenvalues). 
An immediate consequence of (1) and (2) is the following. 

(3) If eigenvalues are simple (multiplicity = 1) then the corresponding eigenvectors are orthog- 
onal. 
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